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BRACKETING  DISCRETE  PR0B1.EMS 
BY  TWO  PROBLEMS  OF  UNEAR  OPTTMTZAT ION 

by  Robert  .loros  low 


We  show  that  various  graph-theoretic,  logical,  and  integer 
optimization  problems  on  discrete  structures  possess  a computational 
complexity  which  is  closely  related  to  that  of  two  problems  of 
linear  optimization. 

The  first  problem  considered  is  that  of  parametric  linear 
programming , as  used  toward  error  analysis  for  errors  in  the  criterion 
function  alone.  We  show  that  the  problem,  of  determining  whether  a 
certain  compact  formula  is  accurate  to  the  first-order  effects  of  these 
errors,  has  a polynomial  time  algorithm  only  if  a large  class  of 
combinatorial  problems  (including  the  tautology  problem)  does  (Theorem  1). 

The  second  problem  considered  is  that  of  ordinary  linear  programming, 
which  is  not  known  to  have  a polynomial- time  algorithm  T5].  We  show  that, 
if  the  tautology  problem  has  a polynomial- time  algorithm,  then  there 
also  is  one  for  linear  programming. 


Notation  and  terminology  is  from  [ 4 ] . In  particular,  P resp.  NP 
denotes  that  class  of  languages  that  is  recognizable  in  polynomial  time 
by  a deterministic  resp.  nondeterministic  Turing  machine. 
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Abstract 


0^ 


^ i 


We_f$*«d/e  ja/o  results??  (1)  If  a certain  restricted  problem  of 
first-order  error  analysis  in  linear  programming  (specified  below), 
for  errors  in  only  the  criterion  function,  has  a polynomial- time 
algorithm,  then  so  does  the  tautology  problem;  (2)  If  the  tautology 
problem  is  decidable  in  polynomial  time,  then  linear  programs  can 
be  solved  optimally  in  polynomial  time. 


Key  Words: 


1)  Linear  programming 

2)  Integer  programming 

3)  Computational  complexity 


The  Main  Results 


Let  a sentential  form (2 be  given  in  disjunctive  normal  form 


-V 


where  each  £2. h is  a conjunction  of  literals 


-A 

/ f d(h,p)  x 


In  (2),  d(h,p)  is  either  a blank  or  a negation  sign  "-i."  We  assume 
that  not  both  x*1’^  and  — i x^,P  occur  in  . We  view  that  is  written 
on  a single  line  (no  subscripting  or  superscripting)  from  left-to-right, 
so  that  (1)  abbreviates  a linear  string  CL1  v C&  v...v  CP  ; and 
similarly  with  (2).  Also,  x^,p  abbreviates  the  symbol  "x(a)"  in  which 
a is  the  index  of  the  literal  occurring  in  the  h-th  disjunct  of  (1), 
in  the  p-th  position  of  this  disjunct  (2),  and  a is  written  in  binary. 
Let  the  indices  actually  occurring  for  literals  in  (1)  be  { i^,...,  i ) 
(possibly  literal  x(ll)  occurs,  but  x(10)  occurs  nowhere). 

We  now  associate  to  ah  in  (2)  a linear  inequality  system 


h h 

An  x > b 


which  is,  by  definition 


niuniiiiisi.wiiii 


[3] 

In  this  caBe, 

(8)  CO-  is  x(10)A  x(101)  A —i  x(l) 
and  (3) , (4)  becomes 

-x(l)  > -1 

-x(10)  > -1 

(9)  -x(100)  > -1 

-x(101)  > -1 

x(10)  > 1 

x(101)  > 1 

-x(l)  > 0 . 

A vector  x = ( xfi^ x(i  ) ) can  be  viewed  as  a (truth) 

valuation  when  its  components  are  only  zeroes  and  ones;  we  view  zero 
as  "false"  and  one  as  "true." 

Lemma  1: 


(10)  | x > 0 | Ahx  > bh  ) = conv 


X 


x is  a valuation 


^ I that  makes  CL  true 

Proof:  Clearly,  if  x is  a valuation  that  makes  true,  then 

Ahx  > bh  ; x > 0 is  also  evident.  Hence  the  direction  2 in  (10)  is  evident. 

ti  h 

For  the  converse,  suppose  x > 0 and  Ax>b  . Ifx  has  only 
zero  or  one  as  components,  clearly  x makes  CLh  true.  Otherwise,  the 
proof  is  by  induction  on  f,  the  number  of  fractional  components  of  x. 

Xf  f > 1,  let  x ( J ) be  a fractional  component  of  x,  From  (4)  and 
x > 0,  we  have  0 < x(J)  < 1.  Since  Ahx  > bh,  x(J)  cannot  be  among  the 


[4] 


variables  xh,P  for  p = 1 t(h).  Let  x^  ' be  x with  x(j)  changed 

to  'O',  and  let  x(1)  be  x with  x(J)  changed  to  '1.'  Then  we  have  a 
convex  combination 


x = x(J)  x<l>  + ( 1 - x(J)>)  x( 


Since  and  x^  have  one  fewer  fractional  component,  by  induction 


(0)  (1)  ! 

x , x « conv  i x 


x is  a valuation 


that  makes  Co  true 


Then  from  (11),  x is  in  the  r.h.s  of  (10). 


Q.E.D. 


In  what  follows,  we  put  c = ( c ( l^),...,c(  i )) 

x 

Lemma  2:  Let  U be  any  open  set  about  (0,...,0)  e R 


Then  we  have 


min  J cx 


for  at  least  one  h = l,...,t 
we  have  A*1  x > bh,  x > 0 


( Z min  { 0,  c(i.)  })  + 5 ( 1CJ  3 

j=l  J J ' 


holds  for  all  c « U,  if  and  only  if  in  (1)  is  a tautology. 


r 


[5] 


Proof:  We  have 


(14) 


min  \ cx 


for  at  least  one  h = l,...,t 
we  have  A^x  > b^,  x > 0 


= min 

min 

{ cx 

h-1 , . . . , t 

= .min 

min 

f cx 

h 1} • • « j 

= min 

| 

x is 

CX  1 

that 

Ls  a valuation 
: makes  CL  true 


ation  \ 
CL  true  J 


■} 


The  second  equality  in  (14)  follows  by  Lemna  1,  and  the  fact  that  the 
extreme  values  of  a linear  form  on  a polytope  occur  at  extreme  points  of 
the  poly tope. 

If  CL> is  a tautology,  all  valuations  x make  C^true,  hence  a minimum 
for  cx  is  attained  by  setting 


(15) 


x(i j)  = 


0 , if  cdj)  > o 

1 , if  cdj)  < 0 


The  value  of  this  optimum  (15)  is  min  { 0,  c(i^)  },  and  (3)  holds. 

If  CXv  is  not  a tautology,  let  x°  be  a valuation  which  makes 

false.  Suppose  that  U contains  a ball  of  radius  2 5^0  about  (0 0) . 

Define  c by 

(16) 


r 


cdj)  ■ ■ * (V  ■ 1 

4 , if  x°(ij)  = 0 


16] 


Then  for  any  valuation  x we  have 


cx  > cx  + k 6 


where  k is  the  number  of  components  in  which  x differs  from  x 

Since  any  valuation  x that  makes  C^true  must  differ  from  x°  in  at 

least  one  component,  by  (14)  we  have 

r for  at  least  one  h=l,...,t  ( 

(18)  min  j cx  h Kh  . n ) 

[ we  have  A x > b , x > 0 y 

> cx°  + 6 


From  (18)  and  the  fact  that  |c^|  = 6 > 0 for  j = l,...,r  we  see  that 


(13)  fails. 


Q.E.D. 


Lemma_3:  The  disjunctive  program 

minimize  cx 

(19 j subject  to  A^x  > b , x > 0 for  some  h = l,...,t 

and  the  linear  program 


minimize  cx 

(20)  subject  to  A^*x^  - b x^  > 0 , h = l,...,t 

t 


[7] 


Proof:  The  linear  program  (20)  for  the  disjunctive  program 

(19)  is  from  [1],  where  it  was  shown  that  the  values  of  (19) 

h h 

and  (20)  are  equal  when  all  systems  [ x > 0 | A x > b } are 


consistent.  This  is  the  case  here,  since  no  literal  and  its 


negation  both  occur  in 


ah . 


Q.E.D. 


Lemma  4:  A three-tape  Turing  machine  can  convert  the  string 

(jL>  in  (1)  into  the  string  for  the  constraints  of  (20)  in  running  time 

0 (Zh ((X)'*),  where  £.h( CL)  denotes  the  length  of  ^ . 

Proof:  Let  the  input  be  on  Tape  1. 

Then  on  Tape  2 a complete  list  of  the  distinct  variable  indices 

{ 1^,...,  i ] can  be  produced  in  time  0(Zh (CL)^)  by  scanning  Tape  1. 

A block  Z of  zeroes  having  length  equal  to  /£h(  i^)  + 2 

can  be  maintained  on  Tape  3,  toward  obtaining  distinct  indices  of 

h h h 

variables  in  the  systems  Ax  - b > 0. 

When  CZ 11  is  next  scanned  and  rewritten  on  Tape  1,  all  its 
variable  indices  are  changed  by  concatenating  to  the  right  a block 
of  zeroes  that  is  (h  - 1)  copies  of  Z,  as  exhibited  on  Tape  3;  hence 
this  block  never  has  length  exceeding  (t  - l).£h((Z)  < /£h(£Z)^  . 

Each  time  a variable  index  is  thus  changed  at  most  £h(Ci/)  symbols 
must  be  moved  a distance  Zh(CL)^,  hence  at  most  0(£h(Q.)^)  is 
required  each  time.  Since  these  changes  are  performed  at  most  £h((X) 
times,  the  re-indexing  requires  at  most  0(i£h(CL)^)  time. 

In  addition,  when  £2^  is  scanned  for  the  second  time,  the  upper 


[8] 


bounds  represented  by  -x(i^)  > - l,...,-x(ir)  > 1,  are  to  be  added 
(properly  indexed).  Writing  these  bounds  requires  at  most  0(  £h(££)3) 
time  and  space,  with  at  most  Lh(CL)  symbols  to  be  moved  0(  ^h (CL)  ) spaces  at 
most  £-h ((ji)  times.  Thus  the  overall  effort  here  is  at  most  0(/h (&)5). 

Writing  the  last  constraints  of  (20)  requires  at  most  0(  £h((3-)  ) 


time. 


Q.E.D. 


Theorem  1:  Fix  integers  p,q  > 0. 


Suppose  that  there  is  a Turing  machine  which,  given  an  inequality 


system 


Ay  > b 


together  witha  list J of  indices  of  the  variables  y,  determines,  in 
time  f(£h(  Ay  > b,J)),  whether  or  not 

(22)  min  { Ej  c^  | Ay  > b,  y > oj 

< min  £0 ,Cj } + ^ max  {|c^|  jeJ} 

for  all  c e U,  where  U is  the  open  ball  about  the  origin  of  radius 
p/q.  Then  the  tautology  problem  is  decidable  in  time  f(C^h((Z)^+  D) , 
for  some  C,D  > 0. 

In  particular,  if  the  above  determination  can  be  accomplished 
in  polynomial  time,  then  P = NP. 

Proof:  By  Lemma  4,  in  running  time  0(^h the  constraints  (20)  cai 

2 

be  written.  In  time  0(  £h((X)  ) the  set  J can  be  designated  to  be  the 
indices  of  x in  (20).  By  Lemmas  2 and  3,  we  see  that  (22)  holds  if  and 
only  if  (jb  is  a tautology. 

Q.E.D. 


f9] 

Since  the  set  U In  Theorem  1 can  be  only  a neighborhood  of  the 
origin,  there  are  two  ways  of  construing  Theorem  1.  The  first  and 
most  obvious  ene,  is  to  take  U = Rr  and  view  Theorem  1 as  a result  on 
parametric  linear  programming.  But  a second,  viable  alternative 
interpretation  of  Theorem  1,  is  as  a result  about  linear  programming 
with  errors  in  the  criterion  function,  for  which  we  require  to  know 
whether  a specified  solution  form  is  accurate  to  the  first-order  effects 


of  these  errors. 

The  same  techniques  used  to  establish  Theorem  1 can  provide 
similar  results  on  projections  of  linear  inequality  systems. 

For  instance,  it  is  not  hard  to  show  that  the  projection  of  the 
constraints  (20)  upon  only  the  variables  x is  precisely 

( U { x > 0 | Ahx  > bh}  ^ . By  Lemma  1,  this  projection  is 


conv 


conv 


h=l 


< U { x | x in  a valuation  making^  true  } ■ conv  [ x ) 

h=l 


is  a valuation  making  & true  } . Therefore  this  projection  requires 
no  other  defining  inequalities  beyond 


(23)  0 < x(ij)  < 1 , j = l,...,r 

if  and  only  if  a ^ a tautology. 

Now  it  is  easy  to  obtain  the  2r  inequalities  (23)  directly  from 
(20),  and  therefore  the  question, as  to  whether  or  not  the  projection 
onto  co-ordinates  x involves  any  inequality  beyond  those  of  (23)  (other 
than  non-negative  combinations  of  (23)),  is  at  least  as  difficult  as  the 
tautology  problem. 

•a 


[10] 


Incidentally,  the  l•’ourler-Dlnes“Motzkl n elimination  method 
can  be  used  to  project  the  system  (20)  onto  co-ordinates  x,  by 
transferring  the  corresponding  variables,  as  inde terminates,  to  the 
right-hand-side.  Then  the  elimination  method  proceeds  uniformly  in 
the  right-hand-side,  with  the  indeterminates  retained.  It  follows  that 
the  problem,  of  avoiding  eliminations  which  will  only  create  redundant 
information,  is  at  least  as  difficult  as  the  tautology  problem. 

We  next  show  that  ordinary  linear  progranming,  i.e.,  linear  pro- 
gramming with  exact  data,  is  no  more  difficult  than  tasks  in  the 
polynomial  class  of  the  tautology  problem. 

Let  CON  denote  the  problem  of  determining,  whether  the  linear 
inequality  system 


(24) 


Ax  = b,  x > 0 


(x  — (x1 , • . . ,x^) ) 


is  consistent.  As  mentioned  above,  all  data  A,b  in  (24)  are  to  be  in 
binary  integers,  and  different  equalities  are  separated  by  commas  and 
occur  on  one  line.  The  matrix  A is  m by  r,  and  b is  m by  1. 

Lemma  5:  CON  c NP 

Proof:  By  [ 4 , Theorem  1]  it  suffices  to  show  that  CON  is  accepted  by 

a non-de termini  Stic  Turing  machi  ne  which  operates  in  polynomial  time. 

Consider  the  non-deterministic  Turing  machine  which  proceeds 
by  placing  T ("tight")  or  S ("possibly  slack")  next  to  each  variable  x^ 


in  (24),  j = 1 r.  Havine  made  such  arbitrarv  choices  thei-e  a m 


[11] 


If  there  are  more  than  m S' s , rejects  the  string.  If  there 
are  m S's  or  fewer,  let  the  vector  of  x's  which  have  'S'  placed 
next  to  them  be  designated  y,  and  let  the  corresponding  columns  of 
A be  designated  B.  Then  ^ attempts  to  solve  By  = b,  which  has  at 
least  as  many  constraints  as  variables,  using  any  of  the  algorithms 
which  require  only  a cubic  order  of  arithmetic  operations  and  order 
comparisons  to  be  performed.  (Rational  numbers  which  occur  in  these 
computations  are  stored  as  pairs  of  binary  integers).  Since  addition 
and  multiplication  of  two  binary  integers  can  be  accomplished  in 
polynomial  time,  these  algorithms  are  implementable  in  polynomial  time. 

If  there  are  an  infinite  number  of  solutions  to  By  = b,  ^rejects 
the  string.  If  there  is  no  solution  to  By  = b,  ^rejects  the  string. 

If  there  is  a unique  solution  y°  to  By  = b found  by  the  algorithm. 


and  also  y 


>0.  )f 


acepts  the  string.  Otherwise,  ^rejects  the  string. 


From  standard  results  on  linear  inequalities,  if  (24)  is  consistent, 
then  it  has  a solution  with  more  than  m of  the  x' s at  a positive  level, 
with  a corresponding  matrix  B such  that  By  = b has  a unique  solution. 
Therefore  , which  clearly  operates  in  polynomial  time,  determines 


whether  or  not  (24)  is  consistent. 


Let  LP  denote  the  problem  of  computing  an  optimum  to  the 


Q.E.D. 


linear  program 


min  cx 


Subject  to  Ax  = b 


x ^ 0 (x  — (x^ i • • • >Xy)^» 


The  optimum  is  to  be  presented  as  r pairs  of  binary  integers  (p,q), 
which  represent  rational  numbers  p/q  that  are  the  co-ordinates  of  the 
optimum.  If  (25)  is  inconsistent,  the  symbols  "INC"  are  to  be  reported 
as  a solution;  if  (25)  is  consistent  but  has  no  optimum,  then  "UBD"  is 
to  be  reported. 

Note  that  LP  is  a computation  problem,  not  a problem  of  language 
acceptance. 

Theorem  2;  Suppose  that  there  is  a Turing  machine  which  determines 
if  systems  of  the  type  (24)  are  consistent,  and  it  operates  in  time 
f(£h(Ax  = b,  x > 0)). 

Then  for  a suitable  polynomial  p(v),  there  is  a Turing  machine 
which  computes  LP  in  time  not  exceeding 

(26)  (r  + 2)  f ( & £h(cx.  Ax  =b,  x > 0)^  + p^  h(cx.  Ax  =b,  x > 0)). 

In  particular,  if  either  CON  or  the  tautology  problem  is  decided 
in  polynomial  time,  there  is  also  a polynomial  time  algorithm  for 
computing  LP. 

Conversely,  if  LP  is  computable  in  polynomial  time,  then  CON  c P. 
Proof:  We  describe  a Turing  machine  . 


[13] 


First,  decides  If  Ax  = b,  x > 0 Is  consistent  in  time 
f(  £h(Ax  = b,x  > 0))  f(6£h(cx,  Ax  = b,x  > 0)).  If  it  is  not 

consistent,  j reports  "INC"  and  halts. 

Otherwise,  ' ) ' determines  if  the  dual  constraints  0A  < c are 
consistent  in  time  f (/h(0(1)  A-0(2)  A + X = c,  0(1)  > 0,  0(2)  > 0,  X > 0) 

< f(  6 £h(  cx.  Ax  = b,  x > 0)).  If  these  are  inconsistent,  J reports 
"UBD"  and  halts. 

Otherwise,  '-j'  will  proceed  to  determine  the  consistency  of 


systems  of  the  form 


0{1)  A - 0(2>  A + \ = c 


0(2))  b - cx  = 0 
Ax  = b 

x,  ©(1),  0(2),  \ > 0 

Xj  = 0, 


j 6 S, 


for  certain  sets  S^.  Each  one  of  these  consistency  issues  are 

determined  in  time  not  exceeding  f(6£-h(cx,  Ax  =b,  x > 0)).  Note  that 

(27)  is  consistency  if  and  only  if 
P 


(27)* 


0 A < c , 


0 b = cx 


Ax=  b 


x > 0 


In  consistent.  By  standard  results,  (27)^  holds  if  and  only  if 
there  is  an  optimum  to  (25)  with  = 0 for  j e S^. 

Initially,  = {l).  When  (27)^  is  consistent,  we  put 
S ^ s Sp  U { p + 1 } if  p < r;  when  (27) ^ is  inconsistent,  we  put 
Sp+1  < Sp  U t P + 1 ) >\tp)  if  P < r and  sp+1  = sp  - tp)  if  P = r. 

The  systems  (27)  are  examined  for  consistency  in  order 
p = l,...,r,  and  this  requires  time  not  exceeding  rf  (6  £h(cx. 

Ax  = b,  x > 0)  + 3 -£h(cx.  Ax  = b,  x > 0)  + D for  some  constant  D > 0. 

By  construction,  there  is  an  optimal  solution  to  (25)  with 
Xj  = 0 for  all  j c S but  no  such  optimum  with  x^  = 0 for  any 
k ^ By  standard  results,  the  complement  of  Sr+^  has  indices 

corresponding  to  a subvector  y of  x,  possessing  columns  B in  A which 
are  linearly  independent.  Therefore  By  = b has  a unique  solution 
that  is  computed  in  polynomial  time,  and  satisfies  y > 0.  In  this 
manner,  a solution  to  (25)  is  computed  in  time  bounded  by  (26). 

Clearly,  if  f is  a polynomial,  so  is  (26);  and  if  either  CON 
or  the  tautology  problem  is  decided  in  polynomial  time,  f will  be 
a polynomial.  This  gives  the  "particular"  remark.  For  the  "conversely" 
remark,  we  recall  simply  that  Phase  I of  the  Simplex  Algorithm 
determines  consistency  [3  ]. 


Q.E.D. 


Carnegie-Mellon  University 
July  15,  1976 


References 


[ 1]  E.  Bains,  "Disjunctive  Programing:  Properties  of  the  Convex 

Hull  of  Feasible  Points,"  MSRR  no.  348,  Carnegie -He lion 
University,  July  1974. 

[2]  S.  Cook,  "The  Complexity  of  Theorem-Proving  Procedures," 
Conference  Record  of  Third  ACM  Symposium  on  Theory  of  Computing 
1970,  pp.  151-158. 

[3]  G.  Hadley,  Linear  Programing.  Addison-Wesley,  1962. 

[4]  R.M.  Karp,  "Reducibility  Among  Combinatorial  Problems," 
Department  of  Operations  Research,  University  of  California  at 
Berkeley,  April  1972. 

[5]  V.  Klee  and  G.J.  Minty,  "How  Good  is  the  Simplex  Algorithm?," 
in  Inequalities  III.  0.  Shisha,  ed..  Academic  Press,  N.Y. , 1971 


; 


i 

: 


i 


HEAD  INSTR  ' TN  >!■" 
i'irI  OKE  COMPL  l.’PN ( . Mil 

: 1 1*7 inT‘»  catalog  n iVk .% e a 


REPORT  DOCUMENTATION  PAGE 


i GOV!  ACCESSION  NO- 


S.  1YPL  Of  RtSOST  I PERIOD  CQVCdtD 

July,  1976  ^ 


TlTt-C  (anj  SuUllt la) 


BRACKETING  DISCRETE  PROBLEMS  BY  TWO  PROBLEMS  01 
LINEAR  OPTIMIZATION  4 


t PERFOAMlNO  O AG.  AEROHT  i ■.  MUCH 

M.S.R.R.  395 


V AU  r HOBfil 


Robert/ Jeroslow, 


PROGRAM  EL  HUE  NT,  PrlOJPX  r."  I ASK 

AREA  S WORK  UNIT  NUMBERS 


iEHFOAUING  ORGANIZATION  N AW  t AH  T F'BBWESl  ' ' 

GSIA 

Carnegle-Mellon  University,  Pittsburgh  PA 


“CM  RUu  LING  OFFICE  NAME  ANO  ADDRESS 

Personnel  and  Training  Research  Programs 
Office  of  Naval  Research  (Code  458) 
Arlington,  Virginia  22217 

H MONITORING  AGENCY  NAME 


IS  SECURITY  CLASS,  (oi  -k  •rl) 


trol'.tng  Qltt  cm ) 


Unclassified 


I im  DECL  ASSIPIC  ATION'DOWN  ciKA  JiMG 

SCH  f.oulc 


1*  DISTRIBUTION  5T  ATEMf  M T ;o.  thi»  import) 


I y «|H»*r»ON  <:TATPMfMT  , • /;»»  iumrm.1  In  Block  jQ,  H Jl'tmrmnt  from  /import) 


III  *IUPPL  FMFM  TAHY  NOTES 


If.  < E '*  WO^OS  ^CunUnu*  on  r»v#r*«  .«!<#•  it  nmemimmr  arid  idmntlty  ty  hlcck  numbmt) 


Linear  programming.  Integer  programming,  Computational  complexity 


Aflaff  a . f (l  .*  on  rmvmttm  #/./•  It  nmc^mmmry  and  «d«r*f-,',  >it  o * nu-rd«r- 

We  prove  two  results:  (1)  If  a certain  restricted  problem  of  first-order 

error  analysis  in  linear  programming  (specified  below),  for  errors  in  only 
the  criterion  function,  has  a polynomial-time  algorithm,  then  so  does  the 
tautology  problem;  (2)  If  the  tautology  problem  is  decidable  in  polynomial 
time,  then  linear  programs  can  be  solved  optimally  in  polynomial  time. 


Unclassified 

SECUrTVy""cl"aSiTf  I CATION  OF  TNISVaOE  (Whan  Bala  Knlmnd) 


edition  or  i hoy  • * iv  oesoi  * rt 

S/A  o in i-ni4- aao i 


